Edmond
A Novel Multi-Timescale Stability-Preserving Hierarchical Reinforcement Learning Controller Framework for Adaptive Control in High-Dimensional Dynamical Systems
Khaniki, Mohammad Ali Labbaf, Taroodi, Fateme, Safizadeh, Benyamin
Controlling high-dimensional stochastic systems, critical in robotics, autonomous vehicles, and hyperchaotic systems, faces the curse of dimensionality, lacks temporal abstraction, and often fails to ensure stochastic stability. To overcome these limitations, this study introduces the Multi-Timescale Lyapunov-Constrained Hierarchical Reinforcement Learning (MTLHRL) framework. MTLHRL integrates a hierarchical policy within a semi-Markov Decision Process (SMDP), featuring a high-level policy for strategic planning and a low-level policy for reactive control, which effectively manages complex, multi-timescale decision-making and reduces dimensionality overhead. Stability is rigorously enforced using a neural Lyapunov function optimized via Lagrangian relaxation and multi-timescale actor-critic updates, ensuring mean-square boundedness or asymptotic stability in the face of stochastic dynamics. The framework promotes efficient and reliable learning through trust-region constraints and decoupled optimization. Extensive simulations on an 8D hyperchaotic system and a 5-DOF robotic manipulator demonstrate MTLHRL's empirical superiority. It significantly outperforms baseline methods in both stability and performance, recording the lowest error indices (e.g., Integral Absolute Error (IAE): 3.912 in hyperchaotic control and IAE: 1.623 in robotics), achieving faster convergence, and exhibiting superior disturbance rejection. MTLHRL offers a theoretically grounded and practically viable solution for robust control of complex stochastic systems.
- Europe > United Kingdom > England > Oxfordshire > Oxford (0.14)
- Asia > Middle East > Iran > Tehran Province > Tehran (0.04)
- North America > United States > Oklahoma > Oklahoma County > Edmond (0.04)
- Research Report (1.00)
- Overview (1.00)
- Energy (1.00)
- Banking & Finance > Trading (0.46)
- Transportation > Ground > Road (0.46)
Solving the Best Subset Selection Problem via Suboptimal Algorithms
Best subset selection in linear regression is well known to be nonconvex and computationally challenging to solve, as the number of possible subsets grows rapidly with increasing dimensionality of the problem. As a result, finding the global optimal solution via an exact optimization method for a problem with dimensions of 1000s may take an impractical amount of CPU time. This suggests the importance of finding suboptimal procedures that can provide good approximate solutions using much less computational effort than exact methods. In this work, we introduce a new procedure and compare it with other popular suboptimal algorithms to solve the best subset selection problem. Extensive computational experiments using synthetic and real data have been performed. The results provide insights into the performance of these methods in different data settings. The new procedure is observed to be a competitive suboptimal algorithm for solving the best subset selection problem for high-dimensional data.
- North America > United States > Oklahoma > Oklahoma County > Edmond (0.14)
- North America > United States > Alabama > Tuscaloosa County > Tuscaloosa (0.14)
- North America > United States > California > Los Angeles County > Los Angeles (0.04)
DriveFuzz: Discovering Autonomous Driving Bugs through Driving Quality-Guided Fuzzing
Kim, Seulbae, Liu, Major, Rhee, Junghwan "John", Jeon, Yuseok, Kwon, Yonghwi, Kim, Chung Hwan
Autonomous driving has become real; semi-autonomous driving vehicles in an affordable price range are already on the streets, and major automotive vendors are actively developing full self-driving systems to deploy them in this decade. Before rolling the products out to the end-users, it is critical to test and ensure the safety of the autonomous driving systems, consisting of multiple layers intertwined in a complicated way. However, while safety-critical bugs may exist in any layer and even across layers, relatively little attention has been given to testing the entire driving system across all the layers. Prior work mainly focuses on white-box testing of individual layers and preventing attacks on each layer. In this paper, we aim at holistic testing of autonomous driving systems that have a whole stack of layers integrated in their entirety. Instead of looking into the individual layers, we focus on the vehicle states that the system continuously changes in the driving environment. This allows us to design DriveFuzz, a new systematic fuzzing framework that can uncover potential vulnerabilities regardless of their locations. DriveFuzz automatically generates and mutates driving scenarios based on diverse factors leveraging a high-fidelity driving simulator. We build novel driving test oracles based on the real-world traffic rules to detect safety-critical misbehaviors, and guide the fuzzer towards such misbehaviors through driving quality metrics referring to the physical states of the vehicle. DriveFuzz has discovered 30 new bugs in various layers of two autonomous driving systems (Autoware and CARLA Behavior Agent) and three additional bugs in the CARLA simulator. We further analyze the impact of these bugs and how an adversary may exploit them as security vulnerabilities to cause critical accidents in the real world.
- North America > United States > California > Los Angeles County > Los Angeles (0.15)
- North America > United States > Texas > Dallas County > Richardson (0.04)
- North America > United States > Virginia > Albemarle County > Charlottesville (0.04)
- (7 more...)
- Transportation > Ground > Road (1.00)
- Information Technology > Robotics & Automation (1.00)
- Automobiles & Trucks (1.00)
- Government > Regional Government > North America Government > United States Government (0.67)
Videogames 'Fortnite,' 'Minecraft' Catapult Smiley Salamander to Global Fame
A global audience of a half-billion gamers have gotten to know the axolotl, which largely cluster in the canals around Mexico City and look like little dragons with a goofy smile. The videogame "Fortnite" trotted out axolotl characters in 2020, and "Minecraft" followed suit last summer. Roblox, a platform with millions of user-made games, has dozens of axolotl-centric ones, including "Axolotl Tycoon" and "Axolotl Paradise." Axolotls appear in "Adopt Me!," one of the most-played games on Roblox. All of the exposure has spawned axolotl memes, YouTube videos, coloring books and nonfungible tokens.
- North America > Mexico > Mexico City > Mexico City (0.28)
- Africa > Middle East > Egypt > Cairo Governorate > Cairo (0.06)
- Oceania > New Zealand > North Island > Auckland Region > Auckland (0.05)
- (5 more...)
- Information Technology > Communications > Social Media (0.73)
- Information Technology > Artificial Intelligence > Games > Computer Games (0.62)
The 100 Most Disruptive Companies to Watch In 2021
Disruptive technology is the technology that affects the normal operation of a market or an industry. Digital disruption entails established companies and start-ups alike enlisting new technologies in the fight to dislodge incumbents, protect entrenched positions, or to re-invent entire industries and business activities. And to remain disruptive in the market, it is really important to keep innovating. This is crucial because, innovations occur now and then in every industry, however, to be truly disruptive, and innovation must entirely transform a product or solution that historically was so complicated only a few could access it. On a minimum level, digital transformation enables an organization to address the needs of its customers more simply and directly. But through disruptive innovation, companies can offer a far better way to users of doing things that current incumbents simply cannot compete with. Artificial intelligence (AI), E-Commerce, cloud, social networking, Internet of Things, 5G, blockchain and other emerging technologies are being leveraged to blur the lines between industries, creating new business models and converging sectors. A company that disrupts its market is in a great position to take advantage of new opportunities. Sometimes offering something different can change the whole market for the better. Most of the top disruptive companies get this label by offering highly innovative products and services and here are 100 such top disruptive companies listed below. The company provides innovative, managed cloud services to help its customers succeed. With best-in-class service and technology, 403Tech protects companies against cybercrimes while enabling greater efficiency and productivity. Some of its popular services include desktop support, server support, wired and wireless networking, virus removal, data recovery, and backup and hosted cloud services. Aegeus Technologies aims to design and develop robotic technologies and solutions.
- Europe > United Kingdom > England > Greater London > London (0.28)
- North America > United States > Texas > Dallas County > Dallas (0.14)
- North America > United States > California > Orange County > Irvine (0.14)
- (52 more...)
- Research Report (0.68)
- Overview > Innovation (0.34)
- Information Technology > Software (1.00)
- Information Technology > Services (1.00)
- Information Technology > Security & Privacy (1.00)
- (4 more...)